EXTERIOR DIFFERENTIAL SYSTEMS, LIE ALGEBRA 
COHOMOLOGY, AND THE RIGIDITY OF HOMOGENOUS VARIETIES 

J.M. LANDSBERG 

Abstract. These are expository notes from the 2008 Srni Winter School. They have two 
purposes: (1) to give a quick introduction to exterior differential systems (EDS), which is 
a collection of techniques for determining local existence to systems of partial differential 
equations, and (2) to give an exposition of recent work (joint with C. Robles) on the 
study of the Fubini-Grifnths-Harris rigidity of rational homogeneous varieties, which also 
involves an advance in the EDS technology. 
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1. Introduction 

Let G be a complex semi-simple Lie (or algebraic) group, and let V = V\ be an irreducible 
G-module. The homogeneous variety G/P = G.[v\\ C PV is the orbit of a highest weight 
line. 

For example, let W be a complex vector space, V = A k W and let G = SL(W), then 
G/P = G(k, W) C P(A fc VF) is the Grassmannian of A;-planes through the origin in W in its 
Plucker embedding. 

A long term program with my collaborators Laurent Manivel, Colleen Robles and Jerzy 
Weyman is to study relations between the projective geometry of G/P C PV, especially 
its local differential geometry, and the representation theory of G. More than just the 
geometry of G/P, we are interested in the geometry of its auxiliary varieties, for example 
the tangential variety t(G/P) C PV, which is the union of all points on all embedded 
tangent lines to G/P, and the r-th secant variety of G/P, a r (G/P) C PV, which is the 
Zariski closure of all points on all secant P r s to G/P. The auxilary varieties are all 
G- varieties, i.e., preserved under the action of G, and thus one can study their ideals, 
coordinate rings, etc. as G-modules. 

1.1. Overview. These notes are focused on the local projective differential geometry of 
homogeneously embedded rational homogeneous varieties G/P C PV. Specifically, they 
address the question how much of the local geometry is needed to recover G/P. We begin 
by describing many examples of rational homogeneous varieties in §1.21 The main question 
we deal with is rigidity, but before discussing rigidity questions, we give descriptions of 
related projects in $2] to give context to this work. The rigidity results and questions 
are described in $3j In $4] and $5] we give a crash course on exterior differential systems 
(EDS). Roughly speaking, EDS is a collection of techniques for determining the space of 
local solutions to systems of partial differential equations. The techniques usually involve 
extensive computations that can be simplified by exploiting group actions when such are 
present, as with the rigidity questions that will be the focus of this paper. In $6] we describe 
moving frames for submanifolds of projective space and a set of "rigidity" EDS that are 
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natural from the point of view of projective differential geometry. We also describe flexibility 
results obtained using standard EDS techniques. A different method for resolving certain 
EDS associated to determining the rigidity of compact Hermitian symmetric spaces (CHSS) 
was introduced by Hwang and Yamaguchi in [18] that avoided lengthy calculations by 
reducing the proof to establishing the vanishing of certain Lie algebra cohomology groups. 
At first, it appeared that their methods would not extend beyond the CHSS cases, but 
the machinery was finally extended in [39]. This extension is the central point of these 
lectures. Several problems had to be overcome to enable the extension - the problems and 
their solutions are discussed in detail in in $9l The first problem is that the EDS natural 
for geometry is not natural for representation theory, once one moves beyond CHSS. This 
problem is (partially) resolved in £ )9.1I with the introduction of the systems (I p ,J p ) which 
are natural for representation theory. The next problem is that even these natural systems 
do not lead one to Lie algebra cohomology, except in the case of CHSS. However a refined 
version of the (I p ,J p ) systems, the filtered systems do. This is explained in §9.21 

which then leads to our main theorem, Theorem 19.101 Before discussing these systems, we 
describe and compare, for G/P C FV the filtration of V induced by the osculating sequence 
and a filtration induced by the Lie algebra in ^JTJ and briefly review Lie algebra cohomology 
in gSJ 

1.2. Examples of rational homogeneous varieties. 

1.2.1. Generalized cominuscule varieties. The simplest rational homogeneous varieties are 
the generalized cominuscule varieties, which are the homogeneously embedded compact Her- 
mitian symmetric spaces. In addition to the Grassmannians mentioned above, the cominus- 
cule varieties, which are the irreducible CHSS in their minimal homogeneous embeddings, 
are 

• the Lagrangian Grassmannians G u {n,W) = C n /P n C F(A n W/u> A A n ~ 2 W), where 
W is a 2n dimensional vector space equipped with a symplectic form uj € A 2 W*, 
C n is the group preserving the form, and G^(n, W) C G(n, W) are the n-planes on 
which u restricts to be zero. (Note that we may use u to identify W with W* so 
uj A A n ~ 2 W makes sense.) 

• the Spinor varieties S n = D n /P n ~ D n /P n ^\ which are also isotropic Grassmanni- 
ans, only for a symmetric quadratic form, where W again has dimension 2n. Their 
minimal homogeneous embedding is in a space smaller than P(A n H^). 

• the quadric hypersurfaces Q n ~ l = Gq(1,W) C FW, (which are B m jP\ and D m /P\ 
depending if n = 2m + 1 or n = 2m) 

• the Cayley plane OP 2 = E 6 /P 6 ~ E % /P x C PJ 3 (0) which are the octonionic lines 
in O 2 embedded as the rank one elements of the exceptional Jordan algebra ^(O), 
see, e.g., [33J for details. 

• the Freudenthal variety Ej/Pj C P 55 which may be thought of as an octonionic 
Lagrangian Grassmanian G„,(0 3 ,0 6 ), see |33| . 

1.2.2. Products of homogeneous varieties. An elementary, but important generalized comi- 
nuscule variety is the Segre variety. Let V, W be vector spaces, the Segre variety Seg(FV x 
FW) C F(V <g) W) as an abstract variety is simply the product of two projective spaces. 
It is embedded as the set of rank one elements of V ®W . In general, if G/P C PV and 



1 



J.M. LANDSBERG 



G'/P' C PV, we may form the product Seg(G/P x G'/P') C P(V <g> V), which is of course 
a sub-variety of Seg(FV x FV'). 

1.2.3. Veronese re- embedding s of homogeneous varieties. Considering S d V as the space of 
homogeneous polynomials of degree d on V*, we can consider the variety of d-ih. powers 
inside F(S d V), this is isomorphic to FV via the map Vd : FV — » PS^V, [x] ► called 
the Veronese embedding. If X C FV is a subvariety we can consider Vd{X). Its linear 
span (vd(X)) C S^V has the geometric interpretation of the annihilator of Id{X) C S d V*, 
the ideal of X in degree d. In particular, if X = G/P C PV\ is homogeneous, then 
(vd{G/P)) = Vd\, the d-th Cartan power of Vx. 

1.2.4. Generalized flag varieties. Given two Grassmannians G(k,V) and G(£,V) with say 
k < £, we may form the incidence variety Flagk,e(V) = {(E, F) G V) x V) | £ C 
F}. Of course Flag k/ {V) C P(A fc V ® AV) Write A k V = V Wk . Then in fact {Flag k/ {V)) = 
V ulk+LOl giving a geometric realization of the Cartan product of the two modules V UJk and 
V UJl . This generalizes to arbitrary Cartan products as follows: 

The cominuscule varieties are special cases of "generalized Grassmannians" , that is vari- 
eties G/P where P is a maximal parabolic. Such varieties always admit interpretations as 
subvarieties of some Grassmannian, usually given in terms of the set of k planes annihilated 
by some tensor (s). Given two such for the same group, G/Pj C FV Ui and G/Pj C FV Uj , 
we may form an incidence variety G/Pij and again we will have (G/Pij) = V^ i -f £ j-. Thus 
Cartan powers and products of modules can be constructed geometrically. 

1.2.5. Adjoint varieties. After the generalized cominuscule varieties, the next simplest ra- 
tional homogeneous varieties are the adjoint varieties, where V is taken to be g, the adjoint 
representation of G. We write G/P = Xq - C Pg to denote adjoint varieties. The adjoint 
varieties can also be characterized as the homogeneous compact complex contact manifolds. 
It is conjectured (see, e.g., [42j [22]) that they are essentially the only compact complex 
contact manifolds other then projectivized cotangent bundles. Many of these have simple 
geometric interpretations. 

• Xg d L( ^ w ^ = Flagi >n -i(W) is the variety of flags of lines in hyperplanes in the n- 
dimensional vector space W . 

• Xf Q , WQ) = G Q (2,W) C F(A 2 W) = Fso(W) is the Grassmannian of isotropic 2- 
planes in W. 

• X£f 2 = G nu u(2, ImO) is the Grassmannian of two planes in the imaginary octonions 
on which the multiplication is zero. It may also be seen as the projectivization of 
the set of rank two derivations of O, or as the set of six dimensional subalgebras of 
O, see [36], Theorem 3.1. 

• Xg d ^ Woj ^ = V2(FW) C P^VF = Pc n is the variety of quadratic forms of rank one. 

Note that other than the pathological groups A n , C n , all adjoint representations are funda- 
mental. Also note that the adjoint variety of c n is generalized cominuscule for 02 n -i- 

1.3. Notational conventions. We work over the complex numbers throughout, all func- 
tions are holomorphic functions and manifolds are complex manifolds (although much of the 
theory carries over to M, with some rigidity results even carrying over to the C°° setting). In 
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particular the notion of a general point of an analytic manifold makes sense, which is a point 
off of a finite union of analytic subvarieties. We use the labeling and ordering of roots and 
weights as in [2]. For subsets X C PV, X C V denotes the corresponding cone. For a man- 
ifold X, T X X denotes its tangent space at x. For a submanifold X C PV, T X X = T p X C V, 
denotes its affine tangent space, and p € x =: L x . In particular, T X X = x* ® T x X/x. 
If Y C FW, then (Y) C W denotes its linear span. We use the summation convention 
throughout: indices occurring up and down are to be summed over. If G is semi-simple of 
rank r, we write P = Pj C G for the parabolic subgroup obtained by deleting negative root 
spaces corresponding to roots having a nonzero coefficient on any of the simple roots oti s , 
i s € / C {l,...,r}. 

1.4. Acknowledgements. It is a pleasure to thank the organizers of the 2008 Srni Winter 
School, especially A. Cap and J. Slovak. I also thank C. Robles for useful suggestions. 

2. Related projects 

2.1. Representation theory and computational complexity. These projects with 
Manivel and Weyman address questions about G-varieties motivated by problems in com- 
puter science and algebraic statistics, specifically the complexity of matrix multiplication 
and the study of phylogenetic invariants. For a survey on this work see |29j . 

2.2. Sphericality and tangential varieties. For work related to Joachim Hilgert's lec- 
tures |17| , recall that a normal projective G- variety Z is G-spherical if for all degrees d, 
C[Z]d, the component of the coordinate ring of Z in degree d, is a multiplicity free G- 
module, see [3]. Note that this property for Z = t(X) a priori depends both on G and the 
embedding of X. 

Theorem 2.1. Let X = G/P C FV be a homogeneously embedded rational homoge- 
neous variety. Then r(X) is G-spherical iff X admits the structure of a CHSS, and no 
factor of X is G2 / P\ ■ 

In [H] we also show that if G/P is cominuscule then t(G/P) is normal, with rational 
singularities, and give explicit and uniform descriptions of the coordinate rings for all cases 
in the spirit of the project described in §2.31 below. 

An interesting class of r(G/P)'s occurs for the subexceptional series, the third row of 
Freudenthal's magic chart: Se^P 1 x P 1 x P 1 ), G w (3,6), G(3,6), D 6 /P 6 = S 6 , E 7 /P 7 = 
G w (0 3 ,0 6 ) where t(G/P) is a quartic hypersurface whose equation is given by a general- 
ized hyperdeterminant. See [33J for details. The equations of these varieties will play an 
important role in what follows, as the Fubini quartic forms for Xq 1 when G is an exceptional 
group (see §6.2|) . 

2.3. Vogelia. This project, joint with Manivel, is inspired conjectural categorical general- 
izations of Lie algebras proposed by P. Deligne (for the exceptional series) |12^ [13] and P. 
Vogel (for all simple super Lie algebras) [46J. It has relations Pierre Loday's lectures |24j 
because both conjectures appear to inspired by operads. 

Let g be a complex simple Lie algebra. Vogel derived a universal decomposition of S 2 q 
into (possibly virtual) Casimir eigenspaces, S 2 g = C©Y2ffiK; ©^2" which turns out to be 
a decomposition into irreducible modules. If we let 2t denote the Casimir eigenvalue of 
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the adjoint representation (with respect to some invariant quadratic form), these modules 
respectively have Casimir eigenvalues At — 2a, At — 2(3, At — 27, which we may take as the 
definitions of a, /3, 7. Vogel showed that t = a + (3 + 7. For example, for so(n) we may 
take [a, [3, 7) = (— 2,4, n — A) and for the exceptional series sos, f4, tQ, ty, tg we may take 
(a, /3, 7) = (—2, m + 4, 2m + 4) where m = 0,1, 2, A, 8 respectively. Vogel then went on to 
find Casimir eigenspaces Y3, Y~ 3 ', Y3" C S 3 fl with eigenvalues 6i — 6a, 6i — 6/3, 6t — 67 (which 
again turn out to be irreducible), and computed their dimensions: 



dimg 
dim Y2 
dim Y3 



(a - 2t)((3 - 2i)( 7 - 2t) 

t{p - 2t)( 7 - 2t)((3 + t)( 7 + t)(3a - 2t) 

a 2 (3^(a — (3)(a — 7) 
t(a - 2t)(/3 - 2t)(7 - 2i)(/3 + t)(j + t)(t + (3 - a)(t + j - a)(5a - 2t) 



a 3 (3j(a - (3) (a - 7) (2a - (3) (2a - 7) 

In [35} [37] we showed that some of the phenomena observed by Vogel and Deligne persist 
in all degrees. For example, let a denote the highest root of q (here we have fixed a Cartan 
subalgebra and a set of positive roots). Let be the k-th Cartan power of q (the 
module with highest weight ka). 



Theorem 2.2. [37] Use Vogel's parameters a, (3, 7 as above. The k-th symmetric power of 
q contains three (virtual) modules Yk,Y^,Y^' with Casimir eigenvalues 2kt — (k 2 — k)a,2kt — 

we have: 



(k 2 — k)(3, 2kt— (k 2 — k)j. Using binomial coefficients defined by { v ~^ x ) = (1+^) • • • {y+x)/y\, 



dimY k - i i ^ 

k I V k 



t + q f-Z-i+^f-Z-i+k 



)(-% 1+fc ): 



and dim Yj,, dim Y k n are respectively obtained by exchanging the role of a with [3 (resp. j). 

The modules Y^,Y k N are described in |37j. This dimension formula is also the Hilbert 
function ofX* d ([aM) . 

2.4. Cartan-Killing classification via projective geometry. If X = G(k, W) C P(A*W) 
then the variety of tangent directions to lines through a point E £ X is Y = Seg(¥E* x 
F(W/E)) C ¥(E* ® W/E) = FT E X. Moreover one can recover X from Y as the image 
of the rational map P(T®C) --■> F N given by the ideals in degree r + 1 of the varieties 
a r (Y), multiplied by a suitable power of a linear form coming from the C-factor to give 
them all the same degree. In |31] we showed that the same is true for any irreducible 
cominuscule variety. This enabled us to give a new, constructive proof of the classification 
of CHSS, without having to first classify complex simple Lie algebras. Moreover, a second 
construction constructs the adjoint varieties and gives a new proof of the Killing-Cartan 
classification of complex simple Lie algebras without classifying root systems. Here is the 
construction for adjoint varieties: 

Let Y C P"~ 2 = PTi be a generalized cominuscule variety. Define Y to be admissible 
if the span of the embedded tangent lines to Y, as a subvariety of the Grassmannian, has 
codimension one in Is?T\. For generalized cominuscule varieties, this condition is equivalent 
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to Y being embedded as a Legendrian variety. In particular t(Y) is a quartic hypersur- 
face (for the exceptional series, it is the quartic hypersurface described in §2.2j) . Linearly 
embedded T\ C C" C C n+1 respectively as the hyperplanes {x n = 0} and {xq = 0} and 
consider the rational map 

^ . p« p^ c P ( 5 4 c n+1*) 

[x ,...,x n ] ^ [x^xlT^xlx^xlhiY^T^.xlxnTl -x / 3 (r(y)sm 3 ,IPTi),x^-/4(r(y),PT 1 )] 

In [31j we showed that the image is an adjoint variety and that all adjoint varieties arise 
in this way. Here are the Legendrian varieties Y and the Lie algebras of the X*q that they 
produce: 



Y 


c 


pn— 2 







c 


p3 


02 


pi x Qm-4 


c 


p2m— 5 




G w (3, 6) 


c 


pl3 


U 


G(3,6) 


c 


p!9 






c 


p31 


cr 


G„(0 3 ,0 6 ) 


c 


p55 


C8- 



The two exceptional (i.e., non- fundamental) cases are 

pfc-3 u pfc-3 c p2fc-3 s[k 

c P 2 ™- 1 sp 2m . 

See [3TJ [M] for details. The varieties Y C P™ -1 are the asymptotic directions B{II x G d ) c 
FTxXq 1 defined in the next section. 

3. Projective differential geometry and results 

3.1. The Gauss map and the projective second fundamental form. Let X n C FV 

be an n-dimensional subvariety or complex manifold. The Gauss map is defined by 

7: X — * G(n + l,V) 
x 1 — > T X X 

Here T X X C V is the affine tangent space to X at x, it is related to the intrinsic tangent space 
T X X C T X FV by T X X = (T x X/x) (&x* C V/x®x* where x C V is the line corresponding 
to x e FV. Similarly N X X = T X (FV)/T X X = x*®(V/f x X). The dashed arrow is used 
because the Gauss map is not defined at singular points of X, but does define a rational 
map. 

Now let x G X smoot h and consider 

d lx : T X X T fxX G{n + 1, V) ~ (T^X)* ® (V/f x X) 

Since, for all v G T X X, x C ker dj x (v), where d^ x (v) : T X X — > V/T X X, we may quotient by 
x to obtain 

dx, e ® (f x x/x)* ® F/(f s x) = (r;x) ® 2 ® iv^x 
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In fact, essentially because mixed partial derivatives commute, we have 

d lx G S 2 T*X®N X X 

and we write II X = d'y , the projective second fundamental form of X at x. II X describes 
how X is moving away from its embedded tangent space to first order at x. 

One piece of geometric information that II X encodes is the following: Think of FT X X C 
FT X (FV) as the set of tangent directions in T X FV where there exists a line having contact 
to X at x to order at least one. Then B(II X ) := F{v £ T X X \ II(v, v) = 0}, often called the 
set of asymptotic directions, is the set of tangent directions where there exists a line having 
contact to X at x to order at least two. To study the (macroscopic) geometry of X, we may 
study the smaller variety B(II X ) and ask: What does B(II X ) tell us about the geometry of 
X? Note that B(II X ) is usually the zero set of codimA quadratic polynomials and thus 
we expect it to have codimension equal to codim (X, FV) (assuming the codimension of X 
is sufficiently small, otherwise we expect it to be empty). 

Now let X = G/P C FV be a homo geneous variety. In particular we have IIx,x — Hx,y 
for all x, y £ X so we will simply write II X = II x x - To what extent is X characterized by 
II X 1 

Aside. If the ideal of a projective variety X C FV is generated in degrees at most d, 
then any line having contact with X to order d at a point must be contained in X. By an 
unpublished theorem of Kostant, the ideals of rational homogeneous varieties are generated 
in degree two, so B(II G l p ) corresponds to the tangent directions to lines through a point. 
Thus, for example, when X = G(k,V), B(II E ) = Seg(FE* x F{V/E)). 

3.2. Second order rigidity. For the Segre variety, B(II Se9 ^ p2x ^ 2 " > ) C P 3 is the union of 
two disjoint lines (P^s). The Segre has codimension four, and normally the common zero 
set of four quadratic polynomials on P 3 is empty. This prompted Griffiths and Harris to 
conjecture: 

Conjecture 3.1. [15] [Griffiths- Harris, 1979] Let X = Seg(F 2 x P 2 ) c P(C 3 <g)C 3 ). Let 
Z 4 C FV be a variety such that at z € Z genera i, IIz,z = II > then Z is projectively equivalent 
to the Segre. 

Theorem 3.2. |26|, [27] The conjecture is true, moreover the same result holds when X is 
any rank two cominuscule variety except for Q n C P™ +1 and 5e<7(P 1 x P m ) c P(C 2 <X> C m+1 ). 

One can pose more generally the question: Given a homogeneous variety G/P C FV, an 
unknown variety Z C FW and a general point z £ Z , how many derivatives must we take 
at z to conclude Z ~ G/P? 

3.3. History of projective rigidity questions. The problem of projective rigidity dates 
back 200 years when Monge showed ^(P 1 ) C P 2 , the conic curve in the plane, is character- 
ized by a fifth order ODE, i.e., it is rigid at order five. More recently, about 100 years ago 
|14j . Fubini showed that in dimensions greater than one, quadric hypersurfaces are rigid at 
order three, i.e., characterized by a third order system of PDE. 

A vast generalization of Theorem 13.21 was obtained by Hwang and Yamaguchi: 
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Theorem 3.3. [18] Let X C P^ be an irreducible homogeneously embedded CHSS, other 
than a quadric hypersurface or projective space, with osculating sequence of length f. Then 
X is rigid at order f. 

See N7.ll for the definition of the osculating sequence. 

Even more exciting than the theorem of Hwang and Yamaguchi are the methods they 
used to prove it. More on this in £ j6.4i 

If one changes the hypotheses slightly, one gets an order two result: 

Corollary 3.4. [28] Let X C PV be a cominuscule variety, other than a quadric hypersur- 
face. Let Y C ¥W be an unknown variety such that dim (Y) = dim V , and such that for 
U € Y genera i, IIy,y = IL X . Then Y is projectively equivalent to X. 

The proof of this result uses two facts: that the higher fundamental forms of cominuscule 
varieties are the (full) prolongations of the second, and that any variety with such funda- 
mental forms must be the homogeneous model (which follows from Theorem 13. 3p . See |28] 
for details. 

3.4. Rigidity and flexibility of adjoint varieties. For the adjoint varieties, it is easy 
to see that order two rigidity fails (see [30]), even though they have osculating sequence of 
length two. These lectures will be centered around the proof of the following theorem: 

Theorem 3.5. [39J For simple groups G, the adjoint varieties X(f C Pfl (other than 
G = A\) are rigid at order three. 

In the case G = A\, Xj? = -^(P 1 ), which Monge showed to be rigid at order five but not 
four. 

Robles and I originally wrote a "brute force" proof of this theorem in December 2006, 
although we had been attempting to use the methods of Hwang and Yamaguchi. Finally, 
when A. Cap visited us in June 2007, in what can only be described as an incredible 
syncronicity, we made the breakthrough needed, in parallel with Cap making a breakthrough 
in his work on BGG operators with maximal kernel. In £JH] I describe the methods, which 
involve a reduction to a Lie algebra cohomology calculation, and which should be useful 
for other EDS questions. I conclude this section with the description of a result that was 
obtained using traditional EDS techniques: 

The adjoint varieties are the homogeneous models for certain parabolic geometries, a 
much discussed topic at this conference. In particular they are equipped with an intrinsic 
geometry that includes a holomorphic contact structure. All the intrinsic geometry is visible 
at order two (including the distinguished hyperplane) except for the contact structure. This 
inspires the modified question: 

Assume Z C fV is such that at z € Z genera i we have IIz,z = II X ° and the resulting 
hyperplane distribution is contact, can we conclude Z ~ Xq 1 ? Of course for G = A\, we 
know the answer is no, thanks to Monge. 

Theorem 3.6. [39J If G / A 1 ,A 2 , then YES! If G = SL 3 = A 2 , then NO!; there exist 
"functions worth" of impostors. 

Remark 3.7. Although the results are formulated in the holomorphic category, the exact 
same result holds in the real analytic category. 
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The second conclusion has interesting consequences for geometry. A 3-manifold M 
equipped with a contact distribution which has two distinguished line sub-bundles is the 
path space for a path geometry in the plane. Such structures have two "curvature " func- 
tions, call them J\, J2, which are differential invariants that measure the difference between 
M and the homogeneous model, which is Xgj^ 3 = Flagi^C?). This geometry has been well 
studied by many authors, including E. Cartan [9]. For example, if J\ = 0, then the paths 
are the geodesies of a projective connection. See [19J, Chapter 8 for more. 



Theorem 3.8. [39] The general impostor above has J%, J2 nonzero, although they do satisfy 
differential relations. 

This is interesting because it is difficult to come up with natural restrictions on the 
invariants J\, J2 short of imposing that one or the other is zero. A classical analog of 
this situation, where the condition of being extrinsically realizable gives rise to a natural 
system of PDE, is the set of surfaces equipped with Riemannian metrics that admit a local 
isometric immersion into Euclidean 3-space such that the image is a minimal surface. Ricci 
discovered that for this to happen, the Gauss curvature K of the Riemannian metric of the 
surface must satisfy the PDE 

Alog(-K) = 4K 
where A is the Riemannian Laplacian. See [11] [19] for details. 

4. From PDE to EDS 

Exercise: show that any system of PDE can be expressed as a first order system. (Hint: 
add variables.) Thus we only discuss first order systems. We want to study them from a 
geometric perspective, that of submanifold geometry. 

Let 1" have coordinates (x 1 ,...,^™) = (V) and R m coordinates (u 1 , ...,u m ) = (u a ), let 

(4.1) F r (x\u a ,p1) = 1 <r <R 

be a system of equations in n + m + nm unknowns. We view this as a system of PDE by 
stating that a map 

/ : R™ -> R m 

X I — ► u = f(x) 

is a solution of the system determined by (|4.ip if (|4.ip holds when we set u a = f a (x) and 

a du a 

To rephrase slightly, let J 1 ^,^" 1 ) := R n x R m x R nm have coordinates {x\u a ,p^). 
Consider the differential forms 

e a ■= du a -p^dx 1 € n 1 (J 1 0K",M m )) 1 < a < m 

Then we have the following correspondences: 
Graphs of maps / : R n -» M. m 



T f C R n x R m 

Graphs of maps / : R n -> R m , 
F f C R" ■ x R m satisfying 
the PDE system determined bv (|4.1|) 



immersions % : M n — > J 1 (R n ,R m ) such that 
* a ) = and i*(dx 1 A • • • A dx n ) is nonvanishing. 

immersions i : M n -> S C J^R™, R m ) 
such that i*(9 a ) = and i*{dx x A • • • A dx n ) is 
nonvanishing, where S is the zero set of (|4.1[) . 
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Now we are ready for EDS: 

Definition 4.2. A Pfaffian EDS with independence condition on a manifold £ is a sequence 
of sub-bundles I C J C T*S. Write n = rank{J /I). 

An integral manifold of (I, J) is an immersed n-dimensional submanifold i : M — > £ such 
that i*(I) = and i*(J/I) = T*M. 

In the motivating example we had / = {9 a } and J = {9 a , dx 1 }. 

Thus we have transformed questions about the existence of solutions to a system of PDE 
to questions about the existence of submanifolds tangent to a distribution. 

We next show how to determine existence. But first, here are a few successes of EDS: 

• Determination of existence of local isometric embeddings of (analytic) Riemannian 
manifolds into Euclidean space and other space forms, (e.g., Cartan- Janet theorem), 
see, e.g., [HE] 

• Proving the existence of Riemannian manifolds with holonomy G2 and Spiny (Bryant 

• Rigidity/flexibility of Shubert varieties in Grassmannians and other symmetric spaces 
(Bryant [6]). 

• Proving existence of special Lagrangian and other calibrated submanifolds (Harvey 
and Lawson, |16j). 

5. The Cartan algorithm to determine local existence of integral 

manifolds to an eds 

The essence of the Cartan algorithm is to systematically understand the additional con- 
ditions imposed by a system of PDE by the fact that mixed partial derivatives commute. 
In the language of differential forms, this is the statement 

»*(0) = i*(de) = v# e 1. 

For example, in £01 i*{d6) = forces dpf/dx J = dp^/dx 1 and on integral manifolds p% = 
du a /dx l . 

5.1. Linear Pfaffian systems. Among Pfaffian systems, there are those where the set of 
integral elements through a point forms an affine space, the linear systems. 

Definition 5.1. A Pfaffian EDS is linear if the map 

I -> A 2 (T*£/J) 

9 1— > d6 mod J 

is zero. 

To simplify the exposition we will restrict to linear Pfaffian systems. (This is theoretically 
no loss of generality, see [19], Chapter 5.) 

Although some of the theory is valid in the C°° category (see, e.g., [H]), we will work in 
the real or complex analytic category where the theory works best, and in the applications 
of this paper, we will actually work in the holomorphic category. In particular, it makes 
sense to talk of a general point of an analytic manifold, where general is with respect to the 
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EDS on it (e.g., points where the system does not drop rank, where the derivatives of the 
forms in the system don't drop rank, etc.) 

Fix x £ "^general- To determine the integral manifolds through x we work infinitesimally 
and reduce to problems in linear algebra (as one does with most problems in mathematics). 

Definition 5.2. An n-plane E C T X S is called an integral element if 9 X \e= and d9 x \e= 
for all 9 el. 

Let V(I) X C G{n,T x Yi) denote the set of all integral elements at x. As remarked above, 
if (I, J) is linear, then V(I) X is an affine space. Set 

V = {J I '1)1 
W = I*. 

Fix a splitting T*E = J X (B J% and define a bundle map 

W* -» A 2 V 
9 X I— > d9 x mod /, J c 

we may consider this map as a tensor T 6 W ® h?V* , which we call the apparent torsion 
of (I, J) at x. Since the apparent torsion changes if we change the splitting, we instead 
consider 

(5.3) [T]eW®A 2 V*/ ~ 

called the torsion of the system at x, which is well defined. The equivalence ~ is precisely 
over the different choices of splittings and is made explicit in (|5.5p below. 

Since on the one hand we are requiring / to vanish on integral elements but J /I to be 
of maximal rank, if [T] ^ 0, there are no integral elements over x, i.e., V(I) X = 0. If this is 
the case, we start over on the submanifold (analytic subvariety) E'cE defined by [T] = 0. 

Now consider the bundle map given by exterior differentiation, 9 t—* d9 mod I, a compo- 
nent of which is / — > (T*S/J) ® J. Pointwise this is a linear map W* — > (T*T,/J) X ®V*, 
which we may consider as a linear map (T*E/J)* — > W ®V*. Let 

A C W®V* 

denote the image of this map at x, which is called the tableau of (I, J) at x. For linear 
Pfaffian systems A corresponds to V(I) X , where we transform the affine space to a linear 
space by picking a base integral element 9% = t: x = 0, where the 9% give a basis of I x and tt% 
give a basis for a choice of J£. The quantity dim A gives us an answer to the infinitesimal 
version of the question: How many integral manifolds of (I, J) pass through x ? 

Example 5.4. Say J = T*£ ; which is the situation of the Frobenius theorem. Then there 
exist integral manifolds iff T = [T] =0. Here A = (0) always (which corresponds to the 
uniqueness part of the theorem). 

We may think of the tableau A as parametrizing the choices of admissible first order 
terms in the Taylor series of an integral manifold at x expressed in terms of a graph. From 
this perspective, the next question is: What are the admissible second order terms in the 
Taylor series? At the risk of being repetitive, the condition to check is that: Mixed partials 
commute! 



EXTERIOR DIFFERENTIAL SYSTEMS, LIE ALGEBRA COHOMOLOGY, AND THE RIGIDITY OF HOMOGENOUS VARIETIES 

5.2. Prolongations and the Cartan-Kahler theorem. Let 

S : W®V*®V* -► W®K 2 V* 

denote the skew-symmetrization map. Define 

A« :=ker<5 U®V*= (A®V*)C\ (W <g> S 2 V*) 

the prolongation of A. We may think of A^ as parametrizing the admissible second order 
terms in the Taylor series. 

At this point we can make explicit the equivalence in (15. 3D , It is 

(5.5) [T] e W ® A 2 y*/(5(^ ® V*) 

Now we know how to determine the admissible third order Taylor terms etc., but should 
we keep going on forever? When can we stop working? The answer is given by the following 
theorem: 

Theorem 5.6 (Cartan, Cartan-Kahler). (see, e.g., [5j[T9],) Let (I, J) be an analytic linear 
Pfaffian system on X, let x E ^general- Assume [T] x = 0. Choose an A-generic flag 
V* = V° D V 1 D • • • D V 71 - 1 D 0. Let Aj := A D (W <g> W). Then 

dimA^ < dim A + dimA\ + • ■ • + dimA n -i. 

If equality holds then we say (J, J) is involutive ai x and then there exist local integral 
manifolds through x that depend roughly on dim(A r /A r _i) functions of r variables, where 
r is the unique integer such that A r _i ^ A r = A r+ \. 



5.3. Flowchart and exercises. Here £1 G A n (J/I) encodes the independence condition: 



Rename £' as S 



Done: 

there are no 
integral manifolds 



Input: 

linear Pfaffian system 
(I, J) on S; 
calculate dl mod I 





Restrict to £' C E 
denned by [T] = 
and fi 



"Prolong", i.e., start over 
on a larger space E; 
rename E as E 
and new system as (I, J) 




Done: 

local existence of 
integral manifolds 



Exercises 5.7: 

Set up the EDS and perform the Cartan algorithm in the following problems: 



1. The Cauchy-Riemann equations u a 
submanifold of J 1 ' 



Vy, Uy 



(Work on a codimension two 
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2. Find all surfaces M 2 C E 3 such that every point is an umbillic point. 

3. Determine the local existence of special Lagrangian submanifolds of P 2n ~ C n . 

4. (For the more ambitious.) Pick your favorite G C SO(p, q) and determine local existence 
of pseudo-Riemannian manifolds with holonomy C G. 

5. After you read £j6j show that Seg{¥ 2 x P 2 ) C P 8 is rigid to order two. Then roll up your 
sleeves to show that S'eg(P 1 x P n ) is flexible at order two. 

5.4. For fans of bases. Here is a recap in bases: take a local coframing of £ adapted to 
the flag I C J C T*£, i.e., write I = {6 a }, 1 < a < rank/, J = {0 a ,u/}, 1 < i < rank (J/ 1), 
T*£ = {8 a ,uj\ir € }, 1 < e < rank (T*£/J). Then there exist functions A, ...,H such that 

d6 a =A a ei ir e f\J + T^uj 1 A J + E^ir" A ir 5 

+ F&6 b Aw' + G a bt 9 b A vr e + ff 6 ° c 6 A 6 C . 

Since we only care about dO a mod / we ignore the second row. The system is linear iff 
E% s = 0. The apparent torsion is T = T^v 1 A v j <g) w a G A 2 Y* <g> VF. The tableau is 

A = {A^v^Wa | 1 <e < rank(T*£/J)} CV*<S>W 

The torsion is 

[T] =T%w a <g> u* A u j mod {(A^ - ^e^)^ <g> v l A u j | G F} 
G W®AV7<5(y4® V*). 

Here F = E or C. 

6. Moving frames for submanifolds of projective space 

Let U = C N+1 . Let G C GL(U) have Maurer-Cartan form u s G ^(G^g). Recall that 
the Maurer-Cartan form has the following properties: 

• left invariance: L*w = u where L g : G — > G is the map a *— > ga. 

• w/rf : T/^G — > g is the identity map 

• dw = —uj Aw or equivalently, dui = —^[u>,uj] (Maurer-Cartan equation) 
(Here [u, r]](v , w) := [to(v),rj(w)] — [u>(w), rj(v)].) 

6.1. Adapted frame bundles. We want to study the geometry of submanifolds Y C PC/ 
from the perspective of Klein, that is we consider Y ~ Z if there exists g G GL{U) such 
that g.l" = Z. In order to efficiently incorporate the group action, we will work "upstairs" 
on GL(U). Consider the projection map 

vr : GL(U) -> PC/ 
(e , ...,ejv) >->• [e ] 

where we view the ej as column vectors. Fixing a reference basis, we may identify GL(U) 
with the set of all bases of U. We will restrict ourselves to submanifolds of GL(U) consisting 
of bases adapted to the local differential geometry ofY C PC/. First, consider Ty := ir~ 1 (Y), 
the 0-th order adapted frames (bases). Let n = dimY. Next consider 

?Y '■= {/ = ( e o, -, ejv) G Ty | f[ eo] Y = {e , e n }} 
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the frames adapted to the flag x C T X Y C U over each point, called the first order adapted 
frame bundle. Write L = x, T = T x Y/x, N = U /T X Y. Adopt index ranges 1 < a, (3 < n = 
dimT x y, n + 1 < fj,,u < dimU - 1. Write gl(U) = (L © T N)* (L T N) and let, 
for example, ojl*®t denote the component of uj taking values in L* T C U* U = Ql(U). 
Write 

(6.1) ^sKU) = I W Up LO v\ = \ <^L*<g>T WT«g>T Un*®T 




u 

W v J \UJL* ® N W T* ® N &N* (g> N j 

Write i : T\ —* GL(U) as the inclusion. We have i*(uJq) = i*{uiL*®N) = 0. (Note that at 
each / G Ty we actually have a splitting [7~ = L0T©iV.) 

6.2. Fubini Forms. Now anytime you ever see a quantity equal to zero, Differentiate it! 
We have 

= ^ i*(dci#) = 
which, using the Maurer-Cartan equation tells us that 

z*KA^)=0 

(note use of summation convention). We are assuming that the forms i*(uJq) are linearly 
independent (as they span the pullback of T*Y by our choice of adaptation) so we must 
have 

for some functions q^ : T\ — ► C. Moreover (exercise) = q^ a for all a, /3 (this is 
often called the Cartan Lemma). The functions q^ vary on the fiber, but they do contain 
geometric information. If we form the tensor field 

F 2 -^o^e^fe,, mod f x Y) G T(T y ,tv* {S 2 T*Y ® NY)) 

a short calculation shows that F 2 is constant on the fibers, i.e. F 2 = it* (I I) for some tensor 
II G T(Y, S 2 T*Y ®> NY). II is indeed the projective second fundamental form defined as 
the derivative of the Gauss map in $3) 

Unlike with the case of the Gauss map, where it was not clear how to continue, here it 
is - we have a quantity equal to zero: uJa — 0.^8^0 so we differentiate it! (From now on we 
drop the i* when describing pullbacks of differential forms to simplify notation.) The result 
is that there exist functions 



such that 



which gives rise to a tensor field 

F 3 G r(F Y ,Ti*(S 3 T*Y®NY)) 

This tensor, called the Fubini cubic form does not descend to be well defined on Y, but it 
does contain important geometric information. 
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6.3. Second order Fubini systems. Fix vector spaces L,T,N of dimensions l,n,a and 
fix an element F 2 G S 2 T*®N®L. Let U = L © T © N, and let to G 1 (GL(C7), gl(U)) 
denote the Maurer-Cartan form. 

Writing the Maurer-Cartan equation component-wise yields, for example, 

d,UL* (g> T = -WL* (g> T A Wl« ® L — WT« (g) T A Ll>l* ® T ~ <^at* g, y A CJl* g at . 

Given i 7 ^ G L(g>S 2 T* ©A, the second order Fubini system for is 

^Fub 2 = Wl* ®N,UT* ®N — F 2 (lOl*®t)}, ^Fub 2 = {-W> 2 > W L* ® t}- 

Its integral manifolds are submanifolds C GL{U) that are adapted frame bundles of 
submanifolds X C PC/ having the property that at each point x G X, the projective second 
fundamental form F 2 x x is equivalent to F 2 . (The tautological system for frame bundles of 
arbitrary n dimensional submanifolds is given by I = {lol*®n}, J = {I, ^>L* ®t}-) 
Let R C GL{L) x GL{T) x GL{N) denote the subgroup stabilizing F 2 and let 

r C (L* L) © (T* <g> T) © (AT* © N) =: gI(C/) ,* 

denote its subalgebra. These are the elements of 0l(f/)o,* annihilating i^. (The motivation 
for the notation fll(J7)o,* is explained in §7.11 ) Assume r is reductive so that we may 
decompose gt(£/)o,* = tffiT 1 as an r-module. 

In the case of homogeneous varieties G/P, F2 G S 2 T* © N © L will correspond to a triv- 
ial representation of the Levi factor of P, which we denote Go- For example, let G/P = 
G(2, M) C PA 2 M be the Grassmannian of 2-planes. Then R = G = GL(E) x GL(F), T = 
E*®F,N = A 2 E* © A 2 F, and we have the decomposition S 2 T* = (A 2 E © A 2 F*) © (S 2 E © S 2 F), 
and F 2 G S 2 T* © N corresponds to the trivial representation in (A 2 E © A 2 F*) © (A 2 E © A 2 F*)*. 

In the notation of 

V ~ L*©T, W ~ (L*©A)ffi(T*©A), A - r 1 , 

with L* © A C W in the first derived system. That C © W may be seen as follows 

d(u)T»®N — F 2 (ul*®t)) = — ut* ®l A col* ®n - wt. 8 tAwt«8JV 

— ^T* ® N A Ll>n* ® iV + F 2 (ujl* ®l A Wl« gr) 
+ -F 2 ® T A Wt* (gi T + <^L* ®JV A UJn* 8 t) 

(6.2) = -u t *®t A^K'^t) - F 2 {ujl*®t) A wat* ^ at 

-^(-WL'giAWi'gT - ^L* ®T A UJT* (8)T) mod/ 

= (wo,*.-f2)Aut«giT mod/ 
= (o; r ± . F 2 ) A ujl*®t mod/. 

To understand the last two lines, wo,* • F 2 denotes the action of the £|[(f/)o,*-valued compo- 
nent wo,* of the Maurer-Cartan form on F 2 G S 2 T* © A. Recall that r is the annihilator of 
this action. By definition wo,* • F 2 = {uj t + u x ±) . F 2 = oj t ±_ . F 2 . 

For the Cartan algorithm we need to calculate = ker 5 where 

5 : x ± © V* -» W © A 2 F* 
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One can check directly that A is never involutive for any F2 system. (One has not yet 
uncovered all commutation relations among mixed partials. This is essentially because we 
have yet to look at the entire Maurer-Cartan form). 

Thus we need to prolong, introducing elements of A^ as new variables and differential 
forms to force variables representing the elements of A^ to behave properly, just as the 
8 a, s forced the p?'s to be derivatives in $H 

Before doing so, we simplify our calculations by exploiting the group action to normalize 
AQ> ~ F3 as much as possible. Write 0t(f7)i,* := T* ®L + N* ®T. Consider the linear map 

S : sKU)i,* -» (L* (g> T) ® r x = V* ® A 
defined as the transpose of the Lie bracket 

[,]:Bl(U) 1 ,.xL®T*^v L Csl(U) ,* 
Now L®T* C fl[(Z7)_i., := &K U )*.*- Then we define 

(1) ker<5 : A®V* -> W ® k 2 V* 
red '~ Image <5 : flt(C/)i,* -> A&V*' 

One can calculate directly, that when X is a rank 2 CHSS in its minimal homogeneous 
embedding (other than a quadric or P 1 x P m ) and F2 = II X , that A^ d = 0. In these cases, 
we begin again with a new system 

/:={/, Wr x} 

on GL(U). Again, one can check that A is never involutive, but that A re d^ = 0. Finally, 
one defines 

which turns out to be Frobenius in the case of rank 2 CHSS, i.e. A^ = 0, which implies 
rigidity. 

6.4. An easier path to rigidity? A better way to obtain the same conclusion is to observe 
that A^J d looks like the graded Lie algebra cohomology group H^Q-^^) defined in §8j In 
the CHSS case, it indeed is this cohomology group, but in all other cases it is not. In the 
next few sections we will see that the corrrespondence is exact in the CHSS case, and how 
it fails in all other cases - it fails in two ways, but none the less, with the introduction of 
certain filtered EDS, the use of Lie algebra cohomology can be recovered. 

7. Osculating gradings and root gradings 

As mentioned above, for homogeneously embedded CHSS, the osculating filtration and 
a filtration induced by the Lie algebra coincide, but that these two differ for all other 
homogeneous varieties. In this section we explain the two nitrations. 
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7.1. The osculating filtration. Given a submanifold X C PC/, and x G A, the osculating 
filtration at x 

U C Ui C • • • C U r = U 

is denned by 

U = x, 
Ux = f x X, 

U 2 = U l +F 2 {L*®S 2 T X X) 

U r = U r -i + F r (L*®( r ~V ®S r T x X). 

We may reduce the frame bundle T\ to framings adapted to the osculating sequence by 
restricting to e = (eo, e a , e^ 2 , . . . ,e /J/ .) G .F^ such that [eo] G X, Tj eo ]A = span{eo,e Q } and 
Uk = span {eo, e a , e^ 2 , . . . , e Mfc }. (The indices a and //j respectively range over 1, . . . , n and 
dimUj-i + 1, . . . , dimUj.) From now on we work on this reduced frame-bundle, denoted 
-Fx c F\- 

At each point of T r x we obtain a splitting of U. This induces a splitting 

gt(U) = mW) k ,* ■ 

(The asterisk above is a place holder for a second splitting given by the representation 
theory when X = G/P that we define in §7.21 ) 

The osculating filtration of U determines a refinement of the Fubini forms. Let N k = 
Uk/Uk-x and define F k:S : N* -> L® t 8 " 1 ) ® S S T*A by restricting F s £N k *®L*® C 8 " 1 ) S^X 
to iV^. Although the Fubini forms do not descend to well-defined tensors on X, the /im- 
damental forms F kk do. By construction, i*]^ : L* ®( fc_1 ) (g> S k T x X — > N kx X is surjective. 



7.2. The root grading. Let g be a complex semi-simple Lie algebra with a fixed set of 
simple roots {ai, a r }, and corresponding fundamental weights {u>i, ... ,lu t }. Let 7 C 
{1, . . . , r}, and consider the irreducible representation \i : g — > gl(f7) of highest weight A = 
^ ieJ A*Wj. Set g = ju(fl), and let (jl{G) C GL(U) be the associated Lie group so that 
G/P C PC is the orbit of a highest weight line. Write P = Pj C G for the parabolic 
subgroup obtained by deleting negative root spaces corresponding to roots having a nonzero 
coefficient on any of the simple roots ai, i € L 

Since g is reductive, we have a splitting gl(U) = g©g 1 , where g 1 - is the g-submodule 
of gl(U) complementary to g. Let to G Q 1 (GL(U), gl(U)) denote the Maurer-Cartan form 
of GL(U), and let u> g and lu q ± denote the components of u> taking values in g and g- 1 , 
respectively. 

The bundle ^Fq/ p admits a reduction to a bundle T^jp = fJ>{G). On this bundle the 
Maurer-Cartan form pulls-back to take values in g, that is, w ± = 0. Conversely, all dim (G) 
dimensional integral manifolds of the system I = {w g ±} are left translates of n{G). 

Let Z = Zi C t be the grading element corresponding to Yli ei § ra ding element 

Zi for a simple root on has the property that Zi(otj) = <5*. In general Z = Y^i s ei %i s . Thus, 
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if (c _1 ) denotes the inverse of the Cartan matrix, then given a weight v = u^ujj, 
(7.1) Z(y) = £ vi(c-\ is . 

l<j<r 
is&I 

The grading element induces a Z-grading of g = ® k _ k Qk- To determine k in the case P = P ai 
is a maximal parabolic, let a = ^mjCtj denote the highest root, then k = rrn. 
The module U inherits a Z-grading 

u = u z(x) e u Z (x)-i e • • • e u z(x) _ f . 

The Uj are eigen-spaces for Z. This grading is compatible with the action of g: n(gi).Uj C 
C/j+j. We adopt the notational convention of shifting the grading on U to begin at zero. The 
component Uq (formally named Uz(\)) is one dimensional, and corresponds to the highest 
weight line of U, and G-FU = G/P C FU. (The labeling of the grading on gl(U) = U*®U 
is independent of our shift convention.) 

Note, in particular, that the vector space Tj Id i(G/P)/Id ~ g/p is graded from —1 to —k. 
The osculating grading on U induces gradings of gl(U), g and g ± . In Examples 17.31 and 17.41 
the summands in T X G/P appearing are in order from —1 to —k 

We write 

0l(EO=©tf(tf).j 

where the first index refers to the osculating grading ( §7. 1|) induced by G/P C PC/ and the 
second the root grading. We adopt the notational convention 

s 

so if there is only one index, it refers to the root grading. Note that the grading of gl(U) is 
indexed by integers —/,...,/. 

7.3. Examples of tangent spaces and osculating filtrations of homogeneous vari- 
eties. 

Example 7.2. Consider G{k,V) C PA k V = FU. Fix E £ G(k,V). Then the osculating 
sequence is 

Uq = A k E C (A fc ^£ A V) C (A k ' 2 E A A 2 V) C • • • C (A 1 ^ A A* _ V) C A k V = U. 

Remark. The only nonzero Fubini forms of a homogeneously embedded CHSS are the fun- 
damental forms. For the adjoint varieties, the only nonzero Fubini forms are ^2,2, -^2,3) -^2,4- 

One definition of G/P C being cominuscule is that Tid{G/P) is an irreducible P- 
module. Here are some examples describing tangent spaces and osculating sequences of 
non-cominuscule varieties. 
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Example 7.3. For orthogonal Grassmannians Gq{k,V) C ¥A k V (assume k < \dimV), 

(T E (G Q (k,V))U = E* ®{E^/E) 

(T E (G Q (k,V))U = A 2 E*, 

where the _L refers to the Q-orthogonal complement, gr to the associated graded vector space 
of the filtered vector space TeGq{U, V). Note that E C E 1 - because E is isotropic. 

Example 7.4. For the 89 dimensional variety (E 8 /P 3 ) C PVL 3 = P 6696999 

T_i = U®A 2 W 

T_ 2 = A A W 

T_ 3 = U®A 6 W 

T_ 4 = W 

where U = C 2 is the standard representation of A\ and W = C , the standard representation 
ofAe. 

Remark. For those familiar with Dynkin diagrams, it is possible to obtain T_i and T_j 
pictorially, where T„j is the last summand. For simplicity assume P is maximal, take 
the Dynkin diagram for q, delete the node for P, and mark the adjacent nodes with the 
multiplicity of the bond assuming an arrow points towards the marked note, otherwise just 
mark with multiplicity one. 



o o o •■ 




X = G Q (4,12) T_! = C 4 ®A 2 C 4 

The last filtrand, Tlj is obtained by marking the node(s) associated to the adjoint 
representation of q and taking the dual module in the new diagram. These coincide iff G/P 
isCHSS. 

7.3.1. Symplectic Grassmannians. Here is the full osculating sequence and some details for 
the symplectic Grassmannians taken from [30] (where many other cases with P maximal 
may be found as well): 

Let G UJ (k,2n) = C n /Pk denote the Grassmanian of /c-planes isotropic for a symplectic 
form. Its minimal embedding is to V^ h = A^V = A k V / {VlhA k ~ 2 V), the fc-th reduced 
exterior power of V = C 2n , where SI £ AV denotes the symplectic form on V* induced 
from uj G A 2 V* . 

Let E S G LJ (k, V) and write U = E^/E. A straightforward computation shows that V Wk 
has the following decomposition as an H = SL(E) x Sp(U)-module: 

V Uk = A^ V = A b E* ® A a+b E* <g> A^ U. 

a.b 

(Here dim.E = k and dimf/ = 2n — 2k.) Note that U is endowed with a symplectic form 
induced by the symplectic form on V = C 2n . 
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Proposition 7.5. |30| Let E E G UJ (k, In), let E 1 - D E denote the O- orthogonal complement 
to E and let U = E^/E. Then the tangent space and normal spaces of G UJ (k,2n) are, as 
Go-modules, 





= E*®U, 




= S 2 E*, 


N 2 - 2 


= K 2 E*®K {2) U 


N 2 ,-3 


= S21E* ® U 


N2-4 


= S22E , 


N p ,* 


= A< a >£7 



a+b+c=p 

= k d U ® S 2nd E* . 

d+e=p 

S V E is the irreducible GL(E) module associated to the partition tt. (Here S 2 aibE corre- 
sponds to the partition with a 2's and b 1 's.) In particular, the length of the osculating 
sequence is equal to k + 1, the last non zero term being ~ A fc (C© U). 

Corollary 7.6. [30] 



B(H Gu (k,2n),E) = F{e ® u e 2 I e E E*\{0}, u E U\{0}}. 

This set of asymptotic directions contains an open dense P -orbit, the boundary of which is 
the union of the two (disjoint) closed H -orbits 

Yy ~ P^- 1 x p 2 ™-^- 1 c P(T_i) and Y 2 ~ w 2 (P fe_:L ) C P(r_ 2 ). 



7.3.2. The bigrading for adjoint varieties. For adjoint varieties, T x Xq has a two step fil- 
tration, with the hyperplane being the first filtrand, and the osculating sequence is simply 
x C T C U . The induced bi-grading on gl(C/) OSCja i g is indicated in the table below. 





X 


T_i* 


T_ 2 * 


iV-2* 


N- 3 * 


iV_ 4 * 


X 


(0,0) 


(-1,1) 


(-1,2) 


(-2,2) 


(-2,3) 


(-2,4) 


T-x 


(1,-1) 


(0,0) 


(0,1) 


(-1,1) 


(-1,2) 


(-1,3) 


T-2 


(1,-2) 


(0,-1) 


(0,0) 


(-1,0) 


(-1,1) 


(-1,2) 


N_ 2 


(2,-2) 


(1,-1) 


(1,0) 


(0,0) 


(0,1) 


(0,2) 


JV-3 


(2,-3) 


(1,-2) 


(1,-1) 


(0,-1) 


(0,0) 


(0,1) 


iV_ 4 


(2,-4) 


(1,-3) 


(1,-2) 


(0,-2) 


(0,-1) 


(0,0) 



In all cases Tli,T_2 may be determined by the remark above (T_2 is the trivial module as 
there is no node left to mark), and iV_ 2 = l2(Y)*, N-3 = I^{{r(Y)) s i ng ) and iV_4 is trivial 
(corresponding to the quartic generating I^riy))). 



22 



J.M. LANDSBERG 



8. Lie algebra cohomology and Kostant's theory 

Let [ be a Lie algebra and let T be an [-module. Define maps 

&> : A j l*®T -» k j+l l*®T 

in the only natural way possible respecting the Leibniz rule. This gives rise to a complex 
and we define H k (l, V) := ker <9 fc /lmage d k ~ 1 . We will only have need of d° and d 1 which 
are defined explicitly as follows: if X € T and v,w £ I, then 

d°(X)(v) =v.X, 

and if a ® X G A 1 !* (g> T, then 

(8.1) a 1 (a®A)(«A w) = a([v,w})X + a(w)w.A — a{w)v.X 

Now let 1 be a graded Lie algebra and V a graded [-module. The chain complex and Lie 
algebra cohomology groups inherit gradings as well. Explicitly, 

d l d : ©i(Li)* -> ©j-< m ([_,-)* A (L m )* ® r d _j_ m . 

Kostant [23] shows that under the following circumstances one can compute H k (l, V) 
combinatorially: 

(1) [ = nCpCgis the nilpotent subalgebra of a parabolic subalgebra of a semi-simple 
Lie algebra g. 

(2) T is a g-module. 

Under these conditions, letting go C p be the the (reductive) Levi factor of p, H J (n,T) 
is naturally a go- m °dule. Kostant shows that for any irreducible module T it is essentially 
trivial to compute -ff 1 (n, T), one just examines certain simple reflections in the Weyl group. 
However, in our situation, where we need to compute H l (g,g^), there may be numerous 
components to g^, and moreover we would like to avoid a case by case decomposition. 
Here the beauty of the grading element comes in, because it is easy to prove that in many 
situations H^(s, T) is zero in positive degree. This is well documented in [47l[18j[39] among 
other places. 

9. From the Fubini EDS to Filtered EDS 

I now explain how we were led to work with filtered EDS in an effort to use Lie algebra 
cohomology to determine rigidity of homogeneous varieties. 

9.1. Problem 1: Osculating v.s. root gradings. As mentioned above, for CHSS, 
the osculating grading coincides with the root grading, but for all other homogeneously 
embedded homogeneous varieties this fails. Thus to have any hope to exploit Lie algebra 
cohomology, we need to work with an EDS that respects the root grading. 

From now on we will work on SL(U) C GL(U) which will not change anything regarding 
our study of rigidity of subvarieties of PC/. Define the (I p , J p ) system on SL(U) by I p = 
{u x }, J p = {I p ,uj s _}. 

In specific examples, after a short calculation, the £;-th order Fubini system can be shown 
to be strictly stronger than some (I p , J p ) system (where of course p depends on k). At the 
moment we have no general method of determining this, but we do so uniformly for adjoint 
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varieties in [39]. In summary, this problem is easy to resolve in specific cases or even classes 
of cases, but work remains to resolve the general case. 
Here is the proof in the adjoint case: 

Proposition 9.1. Every integral manifold of the third-order Fubini system (/Fub 3 > <^Fub 3 ) 
for a given adjoint variety is an integral manifold of the J-i) system for the same 
adjoint variety. 

Proof. Suppose that T C SL(U) is an integral manifold of third-order Fubini system. We 
wish to show that the g^ <0 -valued component of the Maurer-Cartan form vanishes when 
pulled-back to T. That the g> ^-valued component vanishes is an immediate consequence 
of the injectivity of the second fundamental form F2 on each homogeneous component. 

Referring to the table above, we see that there remain four blocks of the component of the 
Maurer-Cartan form in g^ <0 to consider: the three (0, —1) blocks wt_ 2 ®T* 1 , ^>N- 3 <g> N* 2 an d 
wat_ 4 ® tv* 3 ; and the singleton (0,-2) block u;Ar_ 4( ^7vi 2 - The third Fubini form is defined 
by (3.5) of |19[ §3.5]. The vanishing of the g^-component of the first two blocks is a 
consequence of the 5 3 T^ 1 ®A^_3 component of F$. (This is the only nonzero component 
of -F3.) The vanishing of the g- 1- — component of the third and fourth blocks is given by the 
S 3 T* (g> iV_4-component of F 3 . □ 



9.2. Problem 2: Even the systems defined by the root grading do not lead to Lie 
algebra cohomology. For simplicity we take p = — 1 and k = 2. Notice that gjr = sl(U) s 
for all s < —3. Abbreviate 



so that uj 



w s[(C/) s 
u s , for all s < —3. Thus 



-1 



The calculations that follow utilize the Maurer-Cartan equation (see $6]), and that [g, g] C 
g and [g, g -1 ] C j 1 . It is easy to see that duj s = modulo J_i when s < —3. Next, computing 
modulo 



-du ± 
8-2 



and 



-du„± 



+ 



In order for these two equations to be satisfied, on an integral element we must have 

(9-2) uj q ± = XqA^b-i) + V2K-2) 

(9-3) u; g ± = A^i^J + Ai j2 (w _ 2 ) 

for some Ay G gf- ®0-j- 

Consider the degree two homogeneous component 82 of the Spencer differential 8 : 
A&V* — > W®h?V*, where A = gf ©g^ , W = g<_ x (but we may and will ignore the 
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first derived system 0<_ 3 ) V = 0_i (B Q~2- 

h : (st <8> g* i) (flo ® 0-2) (fl-i ® 0-1 A 0-2) © (0-2 ® 0-2 A 0_ 2 ) 

Ai,i©A ,2 !-> {(«-l A«- 2 ) i-> [Ai 5 i(u_i),W_2] + A 0j 2(t>-2)] 
© (x_ 2 , J/-2) !-> [A ,2(ar-2), y-2] + [ar-2, A , 2 (y-2)]} 

Here x_2 G 0-2 etc... This is exactly the Lie algebra cohomology differential d\\ Now 
consider the degree one component 5\ 

Si ■ {do ® 0_i) -> (0-i © 0-i A six) © ( ^2 ® 0-i A 0l 2 ) 

Ao,i ^ {(u-i A u_i) © (x_i, y-2) [A ,i(u_i),u_i] + [u_i,A ,i(v-i)]ffi [A ,i(x_i),2/_ 2 ]} 

This fails to be the Lie algebra cohomology differential because we are "missing" a term 

A-i, 2(^-1, ^-2]) on the right hand side. One can try to "fix" this by adding in such a 

term. At first this appears unnatural, but if one takes into account that there is a natural 

filtration on our manifold, it is not unreasonable to weaken the condition cj„± = to the 

B-i 

condition w ± = 0, i.e., u> s ± = A_i 5 2(w g _ 2 ) where A_i 5 2 € 0i~i ( 8>0_2 at each point of 
our manifold. 

We make this "fix" precise and natural with the introduction of filtered EDS: 
9.3. The Fix for problem 2: Filtered EDS. 

Definition 9.4. Let S be a manifold equipped with a filtration of its tangent bundle T _1 C 
T~ 2 c ••• C T~f = TS. Define an r-filtered Pfaffian EDS on £ to be a filtered ideal 
I C T*E whose integral manifolds are the immersed submanifolds i : M — > £ such that 
i* (I u )\i* (T u ~ r ) = f or a M u > w tth the convention that T~ s = TS when —s < —f. 

Another way to view filtered EDS is to consider the ordinary EDS on the sum of the 
bundles I u <8> (TS/T M+r ). In our case these bundles will be trivial with fixed vector spaces 
as models. 

Define (it, Q) to be the (p + l)-filtered EDS on GL(U) with filtered ideal ll := LO a ± and 

independence condition given by the wedge product of the forms in uj q _ . We may view 
this as an ordinary EDS on 

GL{U) x ([0^(0-2© ••• ©0-jfc)*]©[0p-i® (0-3© ••• ffi0-fe)1©---ffi[0p- fc +2©0-j) 
where, giving g^- linear coordinates Ajj, we have 

(9-5) f p = { uj s ± , s <p-k+ 1; ^ g ±_ fc+2 - \ p - k +2,k( UJ 8-k) > 

U 3p-k+3 ~ "V-fc+3,fc( w 9-J - Ap_A; + 3,fc-l(w g _ fc+1 ) , . . . 

u g£ - A P ,fcH,_ fe ) A Pi2 (^ - 2 ) } 

However, as is explained below, it is more natural to work in the category of filtered EDS. 
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Returning to the p = — 1, k = 2 system, the first derived system is w<_4. Computing 
similarly to above, only now modulo we obtain 



(9.6) - dw_ 3 

(9.7) -d Wff L 



W fl-2> W a ^ 



W 0-2> W a ^ 



+ 



[Wg_ 2 , A_ li2 (W _ 2 )] 



+ [w j _i,A_i i j(w,_j)] + [A_i i2 (w _ 2 ),A_i i2 (a; _ 2 )] 



(9.8) 



+ 



+ 



00 



+ 



0-i So 



+ dA_i i2 (AcJ _ 2 ) - A_i )2 ( [ 



+ [w B i' w fl-i] + 



^9-2)^ 



+ 



+ [A_i >2 (a; _ 2 ),u; 0o ] 
+ [A-i^CWfl.J.WjJ.J + dA_i i2 (Aw _ 2 ) 

- A_i )2 ([w _ 2 ,w 0o ] + [a;^,^] + [A_i i2 (w _ 2 ),A_i, 2 (tj _ 2 )] ) 

Here [-,-] (resp. [-,-] g x) denotes the component of the bracket taking values in g (resp. 
0')- " y 

Note that if were were to view the filtered EDS as an ordinary EDS on SL(U) x g^ (g> Q*_ 2 i 
the term A— 12 is part of the torsion whereas here it is simply part of the tableau of the 
filtered Spencer differential. 

The degree one homogeneous component of (19.6l9.7|9.8j) . is as follows: Ai := ©° = _ 1 A s i_ s 
must be in the kernel of the map 

h : ©°=-i ifft ® 0- s -i) ~+ (S-i ® 0-1 A 0*i) © (g± 2 ® Q*-i A I 2 ) 
defined as follows. Given U-i,V-i £ 0_i, 

(9.9) <5i(Ai)(u_i A u_i) = [Ao,i(«-i),«_i] + [u_i, A ,i(w-i)] - A_i i2 ([ti-i,u-i]). 

For u-i € 0_i, u_ 2 € 0_ 2 

<5i(Ai)(u_i Av- 2 ) = [A ,i(n_i),f_ 2 ] + [u-i, A_i i2 (v-2)] • 

That is, Si = d\, where d\ is the Lie algebra cohomology differential described in JJHJ 

Moreover, g^ = n n qI(U)\, and the Lie algebra cohomology denominator d^(Qi) is the 
space of admissible normalizations of the prolongation coefficients Ai. Thus, the vanishing 
of Hl(g_, q^) implies that normalized integral manifolds of the (jT_ l3 fi) system are in one 

to one correspondence with integral manifolds of the (l/ , f2) system. 

Punch line: by working with filtered EDS and by homogeneous degree we do obtain Lie 
algebra cohomology. The vanishing of the Lie algebra cohomology reduces the system to 
the (Jq,J7) system, and vanishing of the Lie algebra cohomology group H^Q-, Q^) moves 
one to the (I{ , $1) system etc... Moreover, there was nothing special about beginning with 
p = — 1. The final result is: 
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Theorem 9.10. Let U be a complex vector space, and q C Ql(U) a represented complex 
semi-simple Lie algebra. Let Z = G/P C ¥U be the corresponding homogeneous variety 
(the orbit of a highest weight line). Denote the induced %-gradings by Q = © ■ ■ ■ ffiflfc 
and U = Uq © • • • © U-f. Fix an integer p > — 1, and let (J^, $7) denote the linear Pfaffian 
system given by (|9.5p . // ) = 0, for all d > p + 2, then the homogenous variety 
G/P is rigid for the (iX, fi) system. 

10. Open questions and problems 

• Does Hj(q_, q ± ) nonzero imply flexibility? If so, can one prove this directly and in 
general without going through the (sometimes quite long) Cartan algorithm? 

• Give a uniform description of the for all G/P's to obtain uniform determinations 
of Fubini rigidity. 

• Determine the class of extrinsically realizable non flat parabolic geometries modeled 
on Flagi t 2{C 3 ) as some natural class of parabolic geometries. 

• Apply Cap's machinery to study parabolic geometries having families of differential 
operators whose kernel is large but not maximal. 
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